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A rationale is advanced for digitally coding speech signals in terms of 
sub-bands of the total spectrum. The approach provides a means for 
controlling and reducing quantizing noise in the coding. Each sub-band 
is quantized with an accuracy (bit allocation) based upon perceptual 
criteria. As a result, the quality of the coded signal is improved over that 
obtained from a single full-band coding of the total spectrum. In one 
implementation, the individual sub-bands are low-pass translated before 
coding. In another, "integer-band" sampling is employed to alias the 
signal in an advantageous way before coding. Other possibilities extend 
to complex demodulation of the sub-bands, and to representing the sub-band 
signals in terms of envelopes and phase-derivatives. In all techniques, 
adaptive quantization is used for the coding, and a parsimonious allocation 
of bits is made across the bands. Computer simulations are made to 
demonstrate the signal qualities obtained for codings at 16 and 9.6 kb/s. 

I. DIVISION OF SPEECH SPECTRUM INTO SUB-BANDS 

For digital transmission a signal must be sampled and quantized. 
Quantization is a nonlinear operation and produces distortion products 
that are typically broad in spectrum. Because of the characteristics of 
the speech spectrum, quantizing distortion is not equally detectable 
at all frequencies. Coding the signal in narrower sub-bands offers one 
possibility for controlling the distribution of quantizing noise across 
the signal spectrum and, hence, for realizing an improvement in 
signal quality. In earlier work, splitting of the spectrum by high-pass 
and low-pass filtering has been used advantageously for video and 
speech transmission. 1,2 

A question, then, is what design of sub-bands makes sense for 
speech coding? A choice based upon perceptual criteria is suggested, 
namely, band-partitioning such that each sub-band contributes 
equally to the so-called articulation index (ai). 3 The ai concept is 
based upon a nonuniform division of the frequency scale for the speech 
spectrum. Twenty nonuniform contiguous bands are derived in which 
each elemental band contributes 5 percent to the total ai. 
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Appealing to this notion, one partitioning of the frequency range 
200 to 3200 Hz into four "equal-contribution" bands is given below 
and shown in Fig. 1. 



Sub-band 
Number 

1 

2 
3 

4 



Frequency Range 
(Hz) 

200-700 

700-1310 

1310-2020 

2020-3200 



Each sub-band in its original analog form contributes 20 percent to AX. 
The total ai, therefore, is 80 percent, which corresponds to a word 
intelligibility of approximately 93 percent. 4 

II. LOW-PASS TRANSLATION OF SUB-BANDS 

A straightforward approach to processing the sub-bands is to make 
a low-pass translation before coding. This facilitates sampling-rate 
reduction and realizes any benefits which might accrue from coding 
the low-pass signal. 

The low-pass translation can be accomplished in a variety of ways. 
One method is shown in Fig. 2. The input speech signal is filtered with 
a bandpass filter of width W n for the nth band. Wi n is the lower edge 
of the band and Win is the upper edge of the band. The resulting 
signal s n (t) is modulated by a cosine wave, cos (Wi n t), and filtered 
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Fig. 1 — Partitioning of the speech spectrum into four contiguous bands that con- 
tribute equally to articulation index. The frequency range is 200 to 3200 Hz. 
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Fig. 2 — Sequence of operations for low-pass translation of speech sub-bands, 
adaptive pcm encoding, transmission, decoding, and band restoration. 

by a low-pass filter h n (t) with bandwidth (0 - W n ). This filter is 
necessary to remove the unwanted signal images above 2Wi„, as 
shown in Fig. 2. The resulting signal r n (t) corresponds to the low-pass 
translated version of s n (t) and can be expressed in the form: 



r n (t) = [>„(*) cos (W yM*h n (t). 



(1) 



Notice, in this instance, that a constraint is implied by the convolution, 
namely, that the passband width W n ^ 2Wm, or that W 2n S 3JFi„. 
Practically this poses no problem.* 

The signal r n (t) is sampled at rate 2W n . If it is already in digital 
form, the sampling rate is decimated (reduced) to the rate 2W n . This 
signal is digitally encoded and multiplexed with encoded signals from 
other channels as shown in Fig. 3. At the receiver the data is demulti- 



* For example, this constraint requires that W be increased slightly, from 200 to 
233 Hz, for n = 1 in Fig. 1. 
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Fig. 3 — Four-band encoder using low-pass translation and apcm encoding in each 
band. 



plexed into separate channels, decoded, and interpolated to give the 
estimate f n (i) for the nth channel. Reconstruction of the detected 
signal is simply done by the reverse band translation. That is, it is 
modulated by cos (Wi n t) and bandpass filtered to the original pass- 
band, as shown in Fig. 2. The sub-band signal s n (t) is then summed 
with the other bands to give the full-band signal s(t). 

An alternate implementation of the low-pass translation method, 
which avoids the above-mentioned restriction on W n , follows from a 
modification of the complex demodulation process. In this approach, 
s(t) is complex modulated by e' Un( [w n = (Wi„ + W 2 n)/2 = center 
frequency of band n~\ and filtered by a low-pass filter hn(i) with band- 
width (0 - W n /2). The resulting complex signal a n (t) + jb n (t), 



&n(t) = [s(t) COB U n Q*hn(t) 
b n (t) = £s(t) sin CO n f]*hn(t) 



(2a) 
(2b) 



corresponds exactly to the output of the phase vocoder. 5 The conjugate 
of this signal a n (t) — jb n (t) corresponds to a modulation of s(i) by 
e~ iunt . If the complex signal a n (t) + jb n (t) is complex modulated by 
e -}(w n mt an d jt s con j U g a te complex modulated by e HWnl2)t , the two 
resulting complex signals correspond to the negative and positive 
frequency components of the low-pass translated signal r n (t), as shown 
in Fig. 4. The sum of these two signals gives a real signal corresponding 
to the desired low-pass translated signal r n (t) ; i.e., 

r n (t) = 110.(0 + ./&„(«) >-' Wn/2) ' + £a»{t) - jb n (t)2e +jiW "' 2)t > (3) 
or 

r n (t) = 2 L„(0 cos ( ^ t) + 6.(0 Bin H^ t\\ ■ (4) 

For reconstruction, it can be shown that a»(t) and b n (t) can be re- 
covered from the low-pass translated signal r n (t) by the following 
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relations 



o,(0 = L>»(0 cos (W n t/2)Jh' n (t) 
MO = [r.(0 sin (W n t/2)Jh:(t). 



(5a) 
(5b) 



Equations (4) and (5) suggest a method of implementation of the 
low-pass translation and reconstruction with a phase vocoder. For a 
digital implementation of the low-pass translation, this approach is 
particularly appealing. For example, at the sampling rate/, = 2W n /2ir, 
the sequences corresponding to cos (W n t/2) and sin (W n t/2) are 1, 0, 
-1, 0, 1, • • •, and 0, 1, 0, -1,0, • • •, respectively. Therefore, an effi- 
cient way to generate r n (t) is to sample o„ and 6„ (or decimate if they 
are in digital form) to one half of this sampling rate (i.e., W„/2ir) and 
form r n (i) by interleaving samples of a„ and b n (with appropriate 
sign changes). A similar approach can be used in the reconstruction 
process by recognizing that alternate samples of r n (t) cos (W n t/2) and 
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Fig 4 — Frequency-domain interpretation of complex demodulation method for 
low-pass translation. 
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r n (i) sin (W n t/2) (at sampling rate 2W„/2ir) are zero valued. Thus, 
the two input sequences to the interpolators (which can be sampled 
at half of this rate or W n /2r) can be generated by selecting alternate 
samples of r n (t) (with appropriate sign changes). 

A further modification on this approach can be made by noting 
that, since adaptive coding is used to encode r n (t), the sign changes 
in the construction and separation of r n (t) are not necessary. That is, 
an alternate sequence r„(t) can be generated by interleaving samples 
of a„ and 6„ without sign changes. This sequence can be encoded and 
decoded and inputs to the interpolators can be formed from alternate 
samples of fn(t) (without sign changes). Figure 5 shows an implemen- 
tation of this method. The signal s(t) is modulated by cos o) n t and 
sin 03 n t, where «„ is the center frequency of band n. These signals are 
filtered with low-pass filters h„(t) with bandwidth (0 — W n /2). The 
outputs are decimated (if they are in digital form) or sampled (if 
analog) at a sampling rate W n . The low-pass translated signal r»(f) 
is obtained (at sampling rate 2W n ) by interleaving samples of a n and 
b n . K(t) is encoded, transmitted, and decoded as in Fig. 3. On recon- 
struction a„ and 6„ are recovered by selecting alternate samples of 
fn{t). These signals are then interpolated, filtered, modulated, and 
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Fig. 5 — Implementation of complex demodulation for low-pass translation with 
interleaving of samples of a n and b n . 
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summed as shown in Fig. 5 to give the reconstructed sub-band signal 

For digital implementation h' n can be realized with a digital filter. 
Decimation, or sampling-rate reduction by an integer factor M, can be 
achieved by retaining only one out of every M samples of the output 
of the filter. The filter is necessary to avoid aliasing. Interpolation by 
an integer factor M is accomplished by increasing the sampling rate 
by filling in M — 1 zero-valued samples between each pair of input 
samples. The filter h„ then removes the unwanted harmonic images of 
the base-band signal and smooths (i.e., interpolates) these samples to 
appropriate values of the base-band waveform. Efficient methods for 
implementing digital decimators and interpolators are discussed in 
Ref. (6). 

III. ENCODING OF THE SUB-BAND SIGNALS 

Digital encoding of the low-pass translated signal r„(i) is best 
accomplished using adaptive-PCM (apcm). 7 - 8 apcm encoding is preferred 
over adaptive-differential pcm (adpcm) methods in this case due to the 
low sample-to-sample correlation of the low-pass-translated, Nyquist- 
rated, sampled signals. 

For computer simulations, apcm coders based on a one-word step- 
size memory were used according to methods proposed by Jayant, 
Flanagan, and Cummiskey. 7-9 Step-size adaption is achieved accord- 
ing to the relation 

A r = A r _i X M, (6) 

where A r is the quantizer step-size used for the rth sample and A r _i is 
the step-size of the (r - l)th sample. M is a multiplication factor 
whose value depends on the quantizer level at the (r — l)th sample. 
For example, in a two-bit quantizer, two magnitude levels and the 
sign can be represented. If the smaller magnitude level is used at 
time r - 1, M is chosen to have a value M = M i < 1, and if the larger 
magnitude level is chosen, M = M 2 > 1 is used. For a three-bit 
quantizer, four magnitude levels and the sign can be represented. In 
this case, there are four choices for M. Through simulations, appro- 
priate values of M for a two-bit quantizer were found to be M i = 0.845 
and M 2 = 1.96. For a three-bit quantizer, they are M x = 0.845, 
M 2 = 1.0, M 3 = 1.0, and M 4 = 1.4. Note that the three-bit quantizer 
does not change its step-size at time r unless the largest or smallest 
quantizer level is encountered at time r - 1. The above values of M 
are in approximate agreement with values proposed by Jayant 7 for 
full-band apcm encoding. 
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Fig. 6 — Partitioning of the speech spectrum into four noncontiguous bands to 
achieve reduced bit-rate coding. 

IV. SUB-BAND CODING FOR TRANSMISSION AT DATA RATES 

The transmission bit rate of the sub-band coder can be reduced into 
the range of conventional data speeds by further limiting the sub- 
bands in width and tolerating some spectral gaps as shown in Fig. 6. 
Carried to excess, the noncontiguous bands produce a reverberant 
quality in the signal, such as one gets from comb filtering. In moder- 
ation, however, some highly useful compromises can be achieved 
between transmission bit rate and quality. The coded bands still 
cover a respectable range of the speech spectrum, and provide a 
quality considerably better than coding a single full-band signal. 

V. INTEGER-BAND SAMPLING AND HARDWARE CONSIDERATIONS 

Another attractive alternate implementation of these ideas is to use 
"integer-band" sampling to code a signal that is aliased in an advan- 
tageous way. The technique is illustrated in Fig. 7. 

The signal sub-bands s n (t) are chosen to have a lower cutoff fre- 
quency of mf„ and an upper cutoff frequency of (m + l)/ n , where m 
is an integer and /„ is the bandwidth of the nth. band. This bandpassed 
signal is sampled at 2/„ to produce the sampled spectrum shown in 
Fig. 7 (for m = 2). The received signal is recovered by decoding and 
bandpassing to the original signal band. Typically, values of m from 
1 to 3 are most useful for coder applications with lower bands using 
values of m = 1 and upper bands using m = 2 or m = 3. This integer- 
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band sampling technique achieves the theoretical maximum efficiency 
in sampling. 10 

A very attractive advantage of the integer-band sampling approach 
is that it does not require the use of modulators. A slight disadvantage 
is that the above restrictions prevent the choice of bands strictly on 
the basis of equal contribution to ai. However, little loss in performance 
is observed if this equal contribution to ai condition is only approxi- 
mate (within a factor of 2). This implementation was used for per- 
ceptual comparisons, which will be discussed later. 

This approach is especially attractive for implementing the bandpass 
filters as charge-coupled-device (ccd) transversal filters. The analog 
to discrete-time conversion is inherently accomplished by the ccd 
filter with little or no analog prefiltering or post filtering required for 
the prevention of aliasing. The initial signal sampling can be con- 
veniently high, say 15 kHz, to realize the ccd filter, and the filter 
output can be decimated to the 2/„ rate for coding. After transmission 
and decoding, the 2/„ rate can be interpolated to the 15-kHz rate for 
the final bandpass filtering, again by the analog ccd filter. 

Another advantage of ccd filters (and also digital filters) is that 
the filter cutoff frequencies are inherently normalized to the initial 
sampling frequency. Therefore, the sampling frequency and, conse- 
quently, the bit rate of the coder, can be varied over a limited range by 
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Table I — Frequencies and sampling rates for the 16-kb/s coder 



Sub-band 
No. 


Center Freq 
(Hz) 


Kit) 

Sampling 
Rate (a -1 ) 


Decimation 
(From 10 kHz) 


Quantization 
(Bits) 


1 
2 
3 
4 


448 

967 

1591 

2482 


1250 
1429 
1667 
2500 


16 
14 
12 

8 


3 
3 
2 
2 



varying the master clock frequency. This cannot be achieved with 
analog filters. 

Present technology is able to provide four 100-tap ccd transversal 
filters on a single integrated-circuit chip or one 200-tap filter on a 
chip with all necessary drivers and control logic. 

VI. COMPUTER SIMULATIONS OF SUB-BAND ENCODERS 

The sub-band coder has been implemented by computer simulation 
for transmission bit rates of approximately 16 kb/s and 9.6 kb/s. The 
complex demodulation approach in Fig. 5 was used for low-pass 
translation of the bands. An initial sampling rate of 10 kHz was 
employed in both cases. 

The 16-kb/s coder was implemented with the band center frequencies 
and sub-band sampling rates shown in Table I. Band widths are equal 
to one half of the sampling rates and correspond to those shown in 
Fig. 1. Three-bit coders were used in the two lower bands, and two-bit 
coders were used for the upper bands. The filters were 125-tap fir 
filters. As can be observed in Fig. 1, the filters overlap in their transi- 
tion bands and give an overall flat frequency response from 200 Hz 
to 3100 Hz. 

The 9.6-kb/s coder was implemented with the bands given in Table 
II and illustrated in Fig. 6. In this case gaps were allowed between 
bands. Larger filter orders, 175-tap (fir), were used to reduce transition 
bands and conserve bandwidth. Only the lower band used a three-bit 
coder. Upper bands used 2-bit coders. 

Table II — Frequencies and sampling rates for the 9.6-kb/s coder 



Sub-band 
No. 


Wfl 

Center Freq 
(Hz) 


<(t) 
Sampling 
Rate (s _I ) 


Decimation 
(From 10 kHz) 


Quantization 
(Bits) 


1 
2 
3 
4 


448 

967 

1591 

2482 


800 

952 

1111 

1538 


25 
21 
18 
13 


3 
2 
2 
2 
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Illustrations of the signal coded for 16 kb/s and 9.6 kb/s by the 
above-band-translation technique are given by the spectrograms of 
Figs. 8 and 9, respectively. In each figure, the upper spectrogram 
corresponds to the original sentence. The middle spectrogram corre- 
sponds to the signal played through the filters, decimators, and interpo- 
lators — but without coders. The bottom spectrogram illustrates the 
sub-band encoded speech at the designated bit rate. 

Other simulations have also been made for encoding the signals 
a n (t) and b n (t) directly and also for encoding the magnitude and phase 
derivative (as in the phase vocoder). Similar quality results were found 
in these simulations. 

VII. SUBJECTIVE COMPARISONS WITH OTHER ENCODING METHODS 

Informal listening tests were made to compare the quality of the 
sub-band coder simulations with that of full-band encoding. For the 
16-kb/s coder, comparisons were made with 2- and 3-bit adpcm. For 
the 9.6-kb/s coder, comparisons were made with adaptive delta 
modulation (adm) (i.e., 1-bit adpcm). Results for the 16-kb/s coder 
comparisons are given in Table III. 

Twelve listeners were asked to compare pairs of sentences for signal 
quality and indicate which was better. Two speakers were used in the 
experiments and sentence pairs were played in a randomly selected 
order. Each listener made a total of 16 comparisons in each of the 
experiments. 

In comparing 16-kb/s sub-band encoding to 16-kb/s (2 bits/sample) 
adpcm, listeners rated the sub-band encoded sentence as having higher 
quality in 94 percent of the sentence pairs. When the bit rate of the 
adpcm coder was increased to 24 kb/s (3 bits/sample), they rated the 
sub-band encoded sentence as having higher quality in 34 percent 
of the sentence pairs. Experiment I demonstrates that the quality of 
the 16-kb/s sub-band coder is clearly preferred over that of adpcm 
at the same bit rate. In Experiment II listeners exhibited much 
greater indecision, indicating that the quality of the 16-kb/s sub-band 
coder is close to that of 24-kb/s adpcm, but that preference leans 
slightly in favor of the adpcm. 

Also included in Table III are signal-to-quantizing-noise ratios 
(s/n) measured on the speech signals, averaged for the two speakers 
for each of the coding methods, s/n data is not found to be a reliable 
indicator of listener preference. This observation is not surprising 
and has been previously recognized in the speech coding literature. 7,8 

A second series of listening experiments compared 9.6-kb/s sub-band 
coding with adm. The sub-band encoder in this case is implemented 
with the integer-band method described earlier. The adm coder is a 
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Table III — Comparison of 16-kb/s sub-band coder with adpcm 

Experiment 1 : 16-kb/s Sub-band vs 16-kb/s adpcm 



''•- 





Listener 
Preference (%) 


S/N 
(dB) 


16-kb/s Sub-band 
16-kb/s adpcm (2 Bits) 


94 
6 


11.1 
10.9 


Experiment 2 : 16-kb/s Sub-band vs 24-kb/s adpcm 




Listener 
Preference (%) 


S/N 
(dB) 


16-kb/s Sub-band 
24-kb/s adpcm 


34 
66 


11.1 
14.5 



forward step-size transmitting coder shown by Jayant 11 to have 
improved performance over conventional adm. Table IV shows the 
results of these experiments. Three different bit rates, 10.3, 12.9, and 
17.2 kb/s, were used for the adm coder. In the first two experiments, 
the 9.6-kb/s sub-band coder was clearly preferred. In the third experi- 
ment, there was greater indecision with preference leaning slightly in 
favor of the sub-band coder. Note that this is true despite the opposite 
ordering of the s/n values ! In other words, the perceptual palatability 
is not well reflected in the s/ns as has been observed previously. 8 

Table IV — Comparison of 9.6-kb/s sub-band coder with adm 

Experiment 1 : 9.6-kb/s Sub-band vs 10.2-kb/s adm 





Listener 
Preference (%) 


S/N 
(dB) 


9.6-kb/s Sub-band 
10.3-kb/s adm 


96 
4 


9.9 
8.2 




Experiment 2 : 9.6-kb/s Sub-band vs 12.9-kb/s i 


LDM 




Listener 
Preference (%) 


S/N 

(dB) 


9.6-kb/s Sub-band 
12.9-kb/s adm 


82 
18 


9.9 
9.7 




Experiment 3 : 9.6-kb/s Sub-band vs 17.2-kb/s / 


LDM 




Listener 
Preference (%) 


S/N 
(dB) 


9.6-kb/s Sub-band 
17.2-kb/s adm 


61 
39 


9.9 
11 
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14 16 

BIT RATE OF ADM CODER 



Fig. 10 — (a) Relative comparison of quality of 16-kb/s sub-band coding against 
adpcm coding (based on listener preference) for different adpcm coder bit rates, 
(b) Relative comparison of quality of 9.6-kb/s sub-band coding against adm coding 
for different adm coder bit rates. 

Figure 10 summarizes the results of the listener preference tests in 
Tables III and IV. Listener preference is plotted against the adpcm 
and adm coder bit rates. The crossover points of the curves in the two 
comparisons determine the point at which the two types of coders 
have approximately equal subjective quality. In the first comparison, 
the quality of the 16-kb/s sub-band coder is seen to be comparable 
to that of 22-kb/s adpcm; i.e., it has a 6-kb/s advantage over the 
adpcm coder. In the second comparison, the 9.6-kb/s coder has a 
subjective quality that is comparable to the 19-kb/s adm and, there- 
fore, has a 9.4-kb/s advantage over adm. 
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It is clear from the listener preference tests that the sub-band 
coding technique is considerably better in quality than full-band 
adpcm or adm coding methods. We have carried this coding down to 
7.2 kb/s and find that the quality is only slightly poorer than that at 
9.6 kb/s. We have also pressed the coding rate down to 4.8 kb/s and 
find that the quality becomes considerably poorer owing to the in- 
creased band limiting and gaps between bands. 

VIII. CONCLUSION 

We have described a method for digitally coding speech in sub-bands 
of the total signal spectrum. Partitioning into sub-bands has several 
distinct advantages. Bit allocations for quantization of each band can 
be made on a perceptually palatable basis. Quantization products in a 
given band are confined to that band and do not "spill over" into 
adjacent frequency ranges. Selection of sub-band widths can also be 
made according to perceptual criteria, namely, for equal contributions 
to ai (and hence to signal intelligibility). As a result, the sub-band 
coding produces a quality signal that is better than a single full-band 
coding at the same total bit rate. The price paid is the band-filtering 
and the individual coding. 

"Integer-band" sampling is demonstrated to be an economical 
and effective method for implementing the sub-band coder. Emerging 
technologies in device fabrication (such as ccds) suggest economical 
implementations of the band filtering in terms of analog transversal 

filters. 

The sub-band coder, implemented by integer band sampling, is 
demonstrated for speech transmission at rates of 16, 9.6, and 7.2 
kb/s. The latter two transmission rates push down into the data 
range and are attractive for "voice-coordination" over data channels. 

Informal perceptual experiments demonstrate that the signal 
quality of speech coded at 9.6 kb/s by the sub-band method is approxi- 
mately equivalent to a 19-kb/s coding of the full-band signal. For a 
given transmission bit rate, therefore, the sub-band technique provides 
a significant improvement in signal quality. Or alternatively, for a 
given signal quality, the sub-band system can provide the transmission 
at a significantly reduced bit rate. 
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